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We study the temperature structure of the naive TAP equations by mean of a recursive algorithm. 
The problem of the chaos in temperature is addressed using the notion of the temperature evolution 
of equilibrium states. The lowest free energy states show relevant correlations with the ground state, 
and a careful finite size analysis indicates that these correlations are not finite size effects, ruling 
out the possibility of chaos in temperature even in the thermodynamic limit. The correlations of 
the equilibrium states with respect to the ground state are investigated. The performance of a new 
heuristic algorithm for the search of ground states is also discussed. 
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, I. INTRODUCTION 



The mean-field theory of spin glasses (SG) based on the Sherrington-Kirkpatrik (SK) model has revealed very 
interesting properties of its low-temperature phase. Among them there are a rugged free-energy landscape with 
many metastable states, n universality of the probability distribution function of the overlap between states, and their 
■ ultrametric organization^. These properties are common to various randomly frustrated systems, but the full analytic 
control is formulated mostly for the SK model. r-, 

The first attempt toward a Curie- Weiss theory of the SG phase has been done within the TAP theorya, in which 
a set of non- linear equations for the mean site magnetizations {nii} has been introduced much in the same spirit 
oiLthe mean- field equations for ordinary ferromagnets. Such a set of equations has been analytically investigated 
' irjj, where it has been found that the number of minima increases exponentially with the system size (precisely as 
. exp(a(T)N), being a(T) some temperature dependent O(l) constant and N the number of spins), and that there 
^sD ' exists a temperature dependent free energy threshold above which the solutions of the TAP equation are uncorrelated 
0^ , (i.e. their mutual overlap is zero in the limit of N — *■ oo). However a number of questions about the detailed structure 
of the metastable states of the SK model still remains unanswered. 

A direct numerical solution of the TAP equations is difficult because of the so called Onsager reaction term (we 
will discuss about it in the fa lowing), which introduces a portion of the configuration space in which the equations 
themselves lose their validitvEro. Here we will study a simplified version of TAP equations, obtained from the original 
ones dropping the numerically dangerous Onsager reaction term. This new set of equations is known as the naive 
mean-field (NMF) equations, and they become the exact mean-field equations far a generalized SK modefl. This 
model turns out to have strikingly similar SG properties to the original SK modelEl, capturing all the complexities of 
I ■ the SG phase, but with mean-field equations open to easier numerical integration. This model, as well as the original 
' O I SK model, displays Replica Symmetry Breaking. 

The main focus of this work has been the analysis of the organization of the equilibrium states at different temper- 
atures. The motivation that led us to this problem is that while, at least at the mean-field level, it is well known that 
below Tc states at the same temperature in the SG phase are non-trivially correlated, very little is known about the 
correlations between states at different temperatures, despite intense theoretical and numerical efforts on this subject 
in the last fifteen years. 

The hypothesis of the chaos in temperature can be very simply stated in terms of absence of correlations between 
states at different temperatures. It was originally introduced as a constitutive ingredient of the phenomenological 
droplet thcoryO in Wjder to take into account the absence of strong cooling rate dependence experimentally not observed 
in real spin glassest3iI3: the approach to equilibrium of a given observable after cooling from the high temperature to 
a working temperature T\y < Tc does not-depend on the thermal history of the experimental sample, but only on 
the time spent at the last temperature TVO. The puzzle becomes more intricated once we turn our attention to the 
memory effects observed in temperature cycling experimentstj: the state reached by a system at a given temperature 
below Tq is recovered after a negative temperature cycle. The memory effects are manifestly contradicting the chaotic 
scenario suggested by the cooling rate insepsitivity, giving rise at the same time to a number of theoretical explanations 
mostly focused on real space point of viewE3E3. Let us stress a possible source of misunderstanding: inEl it was related 
temperature chaos with bond-chaos, i.e. perturbation on the systems induced by infinitesimal changes in the quenched 
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disorder. While the latter it has been clearly shown to be present^, we believe to be able to demonstrate in what 
follows that the two forms of chaos are different and that, at least at the mean field level, no temperature chaos is 
present. 

On the pure theoretical side, even at the mean-field level, the situation is still far from being satisfactory. Chaos in 
temperature was first advocated in an unpublished work of Sompolinsky, then recpnsidered negatively ir£3 at zero-loop 
order (i.e. for the infinite range limit of the theory), then-again supported int£l at onedoop order (i.e. for the shocjt 
range case). Lastly we point out the work of Franz ct alO where, by means of the coupled real replicas methodta, 
they supported the presence of chaos. This approach was recently reconsidered inEj, where it was demonstrated that 
taking into account higher order perturbation terms, there is no chaos in temperature. _ _ 

On the numerical side, clues of chaos in temperature for short range spin-glass model were discussed inEjE3, while 
our results arc in substantial agreement with the simulations presented inE3 where it was observed that the overlap 
correlation length in 3D Edwards- Anderson model (EA) is a monotonically increasing length scale with respect of the 
asiijLg time, and with the more recent simulations of the SK model and the 3D Edwards- Anderson model presented 
inE3. 

In this work we carried out a careful numerical analysis of the-jsolutions of the naive TAP equations. We solved 
these equations by using a recursive algorithm in the spirit oi&Q. We managed to give a coherent description of 
the temperature structure of the solutions, that we have classified into two families: solutions appearing just below 
the critical temperature which display a bifurcation scenario as the temperature is decreased, and a huge number 
of solutions appearing well below the critical temperature. We have addressed our investigation on the changes in 
temperature of the free energy landscape by operatively defining the temperature evolution of a generic equilibrium 
state. This allowed us for the analysis of the correlations between the ground state and its temperature evolved state: 
the obtained results suggest a temperature smoothly varying free energy landscape, and consequently a non chaotic 
scenario. Exploiting this temperature evolution technique we have also been able to characterize the nature of the 
first solutions just below Tq: it turns out that these solution are highly correlated with the ground state, suggesting a 
scenario in which the first minima appearing just below the paramagnetic phase are also the deepest ones throughout 
the whole SG phase. Let us stress that our findings are strengthened by a careful finite size scaling analysis that 
rules out the possibility that our results are finite size effects. The interpretation of the temperature structure of the 
equilibrium phase space has suggested to us the implementation of a heuristic algorithm for the search of the ground 
states that gives an approximate value for the ground state energy density which is always less than 1% higher than 
the true ground state. 



The paper is organized as follows. In Sec. Owe will introduce both the model and the numerical method. In Sec. Ill 



we will discuss the nature of the tree of solutions of the naive TAP equations in terms of their free energy landscape. 



In Sec. IV we will discuss the temperature organization of the equilibrium states. We will show in terms of free energy 
landscape that the minimum originating from the ground state shifts smoothly with respect of temperature changes 
with no sign of temperature chaos. In Sec. [v| we will discuss the performance of a new heuristic algorithm for the 



search of the ground states. In Sec. VI we will briefly summarize our findings and comment on further developments. 



II. MODEL AND NUMERICAL METHODS 

The main difference between the replica method and the TAP approach is that while in the former we can only 
calculate observables averaged over the disorder probability distribution function, using the latter we can gain in- 
formation about single sample quantities, eventually averaging the results over the disorder at a later stage Qf.-thc 
calculation. A rigorous derivation of the self-consistency equations for the magnetization of the SK model givesaa: 



= tanh 



N N 



(1) 



This formula is a system of N coupled non- linear equations for the local magnetizations m, = (sj). The physical 
interpretation of the terms involved in the TAP equations is rather simple: the first two terms inside the hyperbolic 
tangent in the r.h.s of (Q) are the usual mean-field terms of ordinary ferromagnets, while the last one is the Onsager 
reaction term, which is a measure of the contribution to the internal field acting on the site i coming from the 
magnetization rrii itself. Such a term is relevant in the case of the SK model because the generic coupling Jij oc A -1 / 2 , 
while for a ferromagnetic theory the coupling is 0(1/ N) (the free energy must be proportional to N), so that, at the 
mean-field level, this term is never taken into account. In the paramagnetic phase and for small values of r = Tc — T 
the local magnetizations are expected to behave as rrii = t 1 / 2 + O(r), so that the Onsager term drops to zero as 
t 3 / 2 apart from a constant term whose main effect is to shift the critical temperature. In the low temperature phase 
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(/3 — > oo) a detailed replica calculation shows that qEA = l/N^mf = 1 — 0(f3~ 2 ) (at least for the lowest energy 
states), so that (3(1 — qEA) T-Pifl^ 1 ) and again the Onsager term drops. The analytical calculation presented inEl 
and numerically confirmed inc3, yields a value of Tc — 2 for the critical temperature, where it has to be noticed that 
the critical temperature for the SK model (i.e. for the complete TAP equation ([!])) is Tc = 1. 

In the following we will set to zero the Onsager term and the extern magnetic field hi, and we will use random 
symmetric Gaussian couplings of zero mean and variance 1/N. Under these assumptions we can rewrite ([!]) as follows: 

N 

nii = tanh [ /3 Jij m j \ ■ (2) 

3=1 

As we have mentioned above in the low temperature phase (||) has a lot of solutions. We shall label them with mf , and 
we shall use in general the superscript a to denote quantities such as the free energy F a related to the corresponding 
solution: 

F a = E a - j- , (3) 

where the internal energy E a and the entropy S a are given by: 

E a = - £ Jijmfm? (4) 

l<i<j<N 
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'(l + <) m (^-^-)+(l-m?)ln 



(5) 



In the following we will mainly deal with densities of thermodynamic potentials. We shall adopt for these quantities 
the standard lowercase notation f a ,e a ,s a . 

Let us stress that, at least for the naive TAP equations, it is easy to demonstrate that the critical temperature Tc is 
self-averaging observing that in the paramagnetic phase (i.e. high temperature) the equation (^) can be rewritten as 
rn,; = P^2 k Jijmj. The transition temperature Tc in this contest is the temperature where the paramagnetic solution 
{rrii = 0} becomes unstable. From random matrix theoryEa it is known that this temperature corresponds with the 
higher positive eigenvalue (which is 2) and moreover such an eigenvalue turns out to be self-averaging. 

Denoting with Ns(T) the number of solutions of (||) at temperature T, the link between the TAP formalism and 
the single sample mean-field partition function is given by 

N S (T) 

Zj = £ , (6) 

Q = l 

which encodes the intuitive idea of Boltzmann weighted sum over the solutionS. The internal density of energy can 
be expressed, according to @, as: 

1 *W7 1 1 Ns V) -0F<* « N s( T ) 

— 191n ^)- 1 V- e a (^)= Y (7) 



V dp V ^ Zj d(3 Kr ' <H 

a— 1 a— 1 

where we defined the weights w a = e~@ F /Zj, and we exploited the stationarity conditions d mi F — 0, which are the 
mean- field equations (0). i— in 

In order to solve (||) we used a recursion algorithm in the spirit o£3c3. We start by generating a random initial 
configuration taken from a flat probability distribution function with support in [—1,1], and then we start the 
recursion: 

mf +1) = tanh ^ ; £./,.,////' ' ] . (8) 

The algorithm stops when ^ |to|* +1 ' — < 10~ 6 . The algorithm was implemented in double precision, in order to 
avoid rounding problems. We also checked that the state obtained by the converging recursion is effectively a solution 
of (0) by direct inspection. In the following we will assume that two solution {mf}, {mf } of (0) have to be considered 
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as different whenever \mf — mf | > 10 -2 . Given this requirement we have found no difficulty in distinguishing 
solutions. We have also checked that the results do not change when more stringent bounds are adopted. Note that 
the maximum volume reached in our simulations was N — 200. 

The exhaustive enumeration of the solutions at a given temperature was achieved following this simple procedure: 
each solution obtained by the iteration is accumulated into a stack if it is different from all the other solutions already 
accumulated. Each solution is also labelled with the number of times that it has been found by the recursion. The 
search stops after all solutions in the stack have been found at least 10 times. We also tried to increase this number but 
we did not find any increase in the total number of the solutions, at least within the volume accessible for exhaustive 
enumerations, which for us is TV < 28 for the whole SG phase, and N < 200 down to T = TqJI = 1. We insist 
here on the strict requirement of exhaustive enumeration, by checking that each solution has the magnetic reversal 
counterpart. It is in fact obvious that if {rhi} is a solution of (|2|), also {— will be a solution with the same free 
energy as a consequence of the overall Zi symmetry of the model. 



III. THE TREE OF THE SOLUTIONS 



The detailed knowledge of the temperature scenario of the states of the mean-field SG phase is lacking so far. The 
main problem is that while the more complete description available today is within the replica approach, this task is 
very complex from the analytic point of view. The TAP formalism bypasses this fundamental difficulty allowing us 
for a complete description of the single sample Boltzmann states, at least at a numerical level. 

We havej-already mentioned the exponential number of solution of both TAP equations 2 !, and the naive SK mean- 
field modeH. It would be interesting to understand how each of the solution is related to all the others. The similarity 
between states is given by the scalar product between states, so that if {mf (T)} and {mf (T)} are two different states 
of magnetization at a given temperature T , we can define their mutual overlap as q a p{T) = 1 / N ^2 mf (T)mf (T) . 
Such a scalar product is directly related to the Euclidean distance d a ,p of the two vectors, in fact: 

1 N 2 

i=\ 

In Fig. [I] we present q a p{T) calculated for a and f3 running through all the solutions of (g) for a given sample of 
N = 16 and all temperatures in the window 0.0 <T< 2.5. Decreasing the temperature from T = 2.5 we have a single 
paramagnetic solution, until we arrive around T ~ 1.7 which is the critical temperature of the displayed sample. In 
the low temperature region until T ~ 0.8 we have two solutions related by the Zi symmetry, so that their mutual 
overlap is just ±qea{T). At lower temperature we find an interesting phenomenon: the sudden appearance of another 
solution which is not coming from a bifurcation of the previous ones. Let us recall that from this point down to 
T ~ 0.4 we have 4 = 2x2 solutions, corresponding to 6 = 2 x (2 + 1) points on the figure, so that in general if at 
a given temperature we have n solutions, 2n(n + l)/2 = n(n + 1) points will be displayed. Below T ~ 0.4 we see a 
great number of solutions, mostly concentrated around q — 0. The merging solutions phenomena around T = is due 
to the fact that at this temperature the local magnetizations mi have modulus 1, therefore the allowed values of q a p 
are ±k/N for k = 0, 1, .... N. The reflection symmetry of the figure with respect to the horizontal axis is a signature 
of the Z2 symmetry of (||). We have verified that all the solutions are minima of the free energy defined in (Q), by a 
numerical check of the strict positivity of the Hessian of the matrix <9 2 F calculated on each solution encountered 
at a given temperature. This control has been done using a standard Co on 10 samples of N — 28, and 100 samples 
of N = 24. 

Let us now turn back our attention to the phenomenon of appearance of solutions. The first thing we would like 
to understand is how this could be interpreted in terms of the free energy landscape. Let us denote for definiteness 
with T ai the temperature at which the generic a solution appears. In principle two different scenarios could happen: 
a couple of solutions merging at a certain temperature, or the most common case according to Fig. |l|, the appearance 
of a single solution. While the former case can be interpreted in terms of the usual Landau- Ginzburg potential, the 
latter case can be locally described in terms of a cubic free energy functional of the following form: 

F(m) cx m 3 + (T - T a )m 2 (10) 

A consequence of this cubic potential is that around the minimum q oc y/(T — T a ), so that, as it is visible in Fig. [I], 
the solutions appear with a sudden increase of their derivative with respect to the temperature (See also Fig. ||). We 
also tracked some of the solutions, and we verified that they are effectively proportional to the square root of T — T a . 
It is interesting to note that once a solution appears at T a , it can be continuously tracked down to T = 0, which 
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means, from the point of view of the free energy landscape, that once a local minimum appears, it persists down to 
zero temperature. 



IV. THE ORGANIZATION OF THE STATES AT DIFFERENT TEMPERATURES 



Given the richness of the low temperature phase space unveiled by the tree mentioned above, it would be interesting 
to understand better how these features are connected with the organization of the states. As a first qualitative 
impression from Fig. ^, we could argue that the relative distance of the free energy minima at neighbor temperatures 
seem to be highly correlated, since we observe well defined lines. From this observation we cannot conclude that the 
free energy landscape changes smoothly with temperature since, at least at the level of the tree, we are measuring 
the relative distance of minima but at the same temperature, so that in principle we could still expect a smooth 
covariation of minima, even in presence of dramatic changes in temperature of the free energy landscape: the only 
way to rule out this possibility is to measure the relative distance of minima at different temperatures. 

In order to give a measure of how much temperature affects the phase space structure, we have the following 
strategy: 

• We calculate the ground state for a given sample {rrii(T = 0)}. 

• We plug the ground state into the recursion equation (@) at Xi = 5T = 0.01 initialized with mf^ — rrii(T = 0). 

• We repeat this procedure until we arrive in the high temperature phase of the sample around T = 2. 

We will call this procedure heating of the ground states. In general we can use this procedure with any state, and we 
can decide to decrease instead of increasing the temperature. Hereafter we will address to the thermal path followed 
by any state according to the technique above, as cooling or heating of a state. ._. 

We calculated the ground states up to volumes N = 200 using a Reluctant algorithmEJ. Then we calculated the 
following quantity: 



where we used the {rm(T)} obtained from the ground state heating procedure discussed above, and we have stressed 
with subscript J the sample dependence of the quantity, since we will be eventually interested in its average over 
the sample realizations, which we will denote with the notation g 9S (0,T). In Fig. [3] we display the behavior of 
q gs (0,T), averaged over 1000 samples and for volume N ranging from 50 to 200. It is clear that the heated ground 
state remains similar to its origin at T = up to the critical temperature at T = 2, where one has to keep in 
mind that m,(T ~ Tc) oc (T — Tc) 1 / 2 , so that q gs (0,T) above the critical temperature is zero by definition. It is 
interesting to note that we have fitted the behavior of q 9S (0, T) near Tc obtaining a well behaved square root regime 
in temperature. In terms of the free energy landscape we can conclude that the minimum originating the ground state 
shifts continuously in temperature with no sign of temperature chaos. It is interesting to point out that, as we can see 
from the inset of Fig. ||, the finite size effects even enforce this interpretation since the higher the volume, the smaller 
is the effect of the temperature shift of the minima (the same effect is present throughout the whole low-temperature 
phase, as it is barely visible from the main body of Fig. ||). This last observation allow us reasonably to rule out the 
possibility that we are observing finite size effects. 

One may wonder if the disorder average actually hides something interesting. Some of the single sample q 9S (0,T) 



are displayed in Fig. 0. We start from the top left sample which shows the behavior which we would expect from the 
sample averaged q 9S (0,T) (see Fig. ||), but the other three samples deserve some comments. As the temperature is 
raised from T = one encounters sudden jumps in the overlap with the ground state which can be more or less small, 
but in each case the next valley selected by the recursion, is always positively correlated with the ground state. It 
is interesting to study the finite size dependence of these jumps, so that we have defined a jump a discontinuity in 
the q 9 /{0,T) profile such that (q 3 /(0,T) - q B /(Q,T + 8)) > 0.05 (here 6 = 0.01). In Tab. | we show the average size 
of the jumps Aq 9S : this quantity is almost stable with the size or at least very slowly decreasing (at least within the 
volume considered). At the same time we have also calculated the average number of jumps per sample which turns 
out to be linearly increasing with the size of the system. It is tempting to speculate a thermodynamic limit scenario 
in which each sample has an infinite number of jumps of zero size. 

So far we have concentrated our attention on the temperature properties of the ground state free energy valley, 
in other words we explored only the correlations in temperature of a single valley. One of the advantage of working 




(11) 
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within the TAP formalism is that one can easily get reliable information on single sample Boltzmann-Gibbs averages. 
In order to give a quantitative estimate of the degree of correlation of all the TAP states {mf(T)}, a = 1, Ns(T), 
at a certain temperature T <Tq with the ground state, we will define the following observable: 



N S (T) 



E 



Ns(T) as 




Q 9 f(T)= £ 



w "<?ja(o,r) 



(12) 



a=l 



where q 9 j S a (0,T) = (1/N) rrn(0)mf (T). Since, as we already pointed out, for each solution {mf (T)} we have the 
{— m"(T)} counterpart with the same free energy, in ( p"2|) we considered only solutions with positive overlap with the 
ground state. We show the behavior of the disorder average of this quantity (which we will denote as Q gs (T)) as a 
function of the temperature for sizes N — 50, 100, 150 in Fig. |[ Here the considered number of samples is 1000 for 
each size. Given the relevant computational effort required in the exhaustive enumeration of the solutions, we have 
limited our search in a temperature region Tc/2 < T < Tc- The curves show again a high degree of correlation, and it 
is interesting to note that, at least below T < 1.6, the bigger the volumes, the lower the correlations with the ground 
state. We have interpreted this phenomenon as a consequence of the appearing of a huge number of zero-overlap 
solutions. It is evident that in order to maintain such a correlated scenario, the Boltzmann-Gibbs weights of those 
uncorrelated solutions must be definitely lower compared with the correlated ones: we will try to be more precise in 
the following (see discussion of Fig. ||). Turning our attention to the behavior of Q gs (T) near the critical temperature 
a different finite size scenario holds: the bigger the volumes, the higher the correlations (in this region we have for 
most of the samples just one solution). 

We now present some additional information about the properties of the solutions of (||). In figure Fig. || (upper 
panel) we display a scatter plot of q 9 j S a (0, T) vs. the rescaled free energy density fj — f r j lm at T — 1.2 calculated for 
N = 1000. The results for 1000 samples are superimposed. The bell-shaped pattern shows that there is a systematic 
correlation between lower free energy and higher correlation with the ground state. We think that the cloud of these 
uncorrelated states is a signature of solutions appearing in deep low temperature phase. In the lower panel of Fig. ^ 
we display the probability distribution function of the lowest energy states overlaps with the ground states averaged 
over 1000 realizations of the disorder defined by: 



where the square brackets denote averages over the quenched disorder. We can observe that the distribution is 
strongly peaked around q 9S = =f0.6 confirming at a more quantitative level that the lower the free-energy, the higher 
the number of states highly correlated with the ground state is. Let us point out that a finite size scaling analysis on 
the P (q gs \f — fmin) ( n °t shown in the plot), shows a behavior insensitive to the system size, so that it is impossible 
at this level to guess the thermodynamic limit of (|l^). 



The interpretation of the organization of the states at different temperatures we have given also seems to suggest that 
the first valleys appearing just below the critical temperature are also the deepest ones down to T = 0. This feature 
suggested us to try a simple minded scheme for the search of the ground states. We start at very high temperatures, 
i.e. at temperatures where we are sure that the recursion find only the paramagnetic solutions {m^ = 0}, then we 
lower the temperature smoothly until we find the first state different from zero. At this point we reproduce the 
heating technique introduced above, but now decreasing the temperature until we arrive at zero. We have compared 
the states obtained with this cooling scheme with the output of the Reluctant algorithm we have used in the previous 
analyses and we have verified that we obtain the same results in average for 20% of the samples. 

We have implemented a systematic analysis of the performance of our algorithm for sizes ranging from N = 19 to 
N = 200, for 10000 samples. The results are displayed in Fig. |?]. They are systematically higher out of the error bars, 
but it is interesting to note that the free energy difference with the true ground states, as showed in the inset of Fig. [?|, 
do not increases too much with respect to the system size, lying always below 1%. Let us stress that the time required 
by our algorithm in order to find these quasi ground- states has a polynomial increase with time (approximately as the 
square of the system size). 

The partial failure of the algorithm has suggested us a more detailed analysis of the correlations of the true free 
energy minima with the ground states. When we refer to true free energy minima, we refer to the lowest free energy 
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V. A HEURISTIC ALGORITHM FOR THE SEARCH OF THE GROUND STATES 
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states calculated with the exhaustive enumeration of solution previously explained. The results are reported in the 
main body of Fig. ^ where it is shown that these minima are always highly correlated with the ground states (lower 
curve) but less correlated compared to the states obtained from the ground-states heating procedure explained above 
(the upper curve is taken from the N = 150 curve of Fig. ||). The results in Fig. || are obtained for N = 150, but 
it seems that they do not depend sensibly on the system size. In inset of Fig. ||| we show the free energy difference 
between states obtained by heating the ground state, and true minima. At temperature higher than T ~ 1.6 we see 
there is no difference between this two classes of states, while at lower temperature the heating procedure gives a free 
energy difference lesser than 10~ 2 . Note that this difference will eventually become zero at T = 0, and that the free 
energy difference is of the same order of magnitude of the results displayed in Fig. fij. 



VI. CONCLUSIONS AND PERSPECTIVES 



In this work we have studied the temperature organization of the equilibrium states of the naive TAP mean-held 
equation. Our main focus has been the problem of the chaos in temperature, i.e. whether or not correlations between 
equilibrium states at different temperatures exist. We have numerically solved the naive TAP equations with a 
recursion algorithm which is able to detect only solutions relative to the minima of the free energy functional. The 
equilibrium solutions, according to our analysis, can be classified into two families: solutions rising just below the 
critical temperature following a bifurcation scenario, and solutions appearing at temperatures well below the critical 
one. We have introduced the notion of state heating, which we have used in order to characterize the change in 
temperature of the free energy landscape. We have measured the correlation at different temperatures of the free 
energy minimum relative to T = the ground state. These states are always positively correlated throughout all 
the low temperature phase. The hnite size analysis of these correlations are such that we can exclude that we are 
observing hnite size effects. We have measured also the weighted (according to their Boltzmann-Gibbs thermodynamic 
weights) correlations of all states appearing below the critical temperature Tc with the ground state and again the 
scenario suggested is highly non-chaotic. Another instructive information gained from our numerical study is that 
the hrst minimum appearing at Tc is almost every time the deepest one. We have exploited this unexpected feature 
to implement a heuristic algorithm for the search of the ground state, just by tracking the hrst solution we find at 
T = Tc down to T = 0. The obtained results are interesting, since the pseudo ground states calculated with this 
algorithm always are less then 1% away the true minimum energy density. 

We believe that our findings support clearly a non-chaotic scenario (at least for N < 200). The natural question is 
how much of this scenario remains once we take into account also the Onsager reaction term, i.e. in the SK model 
case. Let us recall that such a term goes to zero as T — > so that, at sufficient low temperature, we should find the 
same phenomenology. Moreover it is known that the naive TAP equation shows full replica symmetry breaking (RSB), 
much the same the SK model, another hint in the sense that what we observe it might be common to all mean-field 
model with RSB scenario. However it would be interesting to dehne the same notion of state temperature evolution, 
for the full fledged TAP equations ([!]). But if on one hand we are confident that, at least at the mean field level, 
the non-chaotic scenario seems to be likely enough, on the other hand we believe that chaos in short range systems 
remains the most challenging problem, and an extension of our techniques for the Edwards- Anderson problem should 
be instructive. 

We acknowledge interesting discussions with T. Rizzo, A. Cavagna, A. Crisanti, and I. Giardina. We especially 
thank E. Marinari and M. Ratieville for interesting discussions and a careful reading of the manuscript. We would 
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FIG. 2. Plot of the free energy landscape relative to the appearance of a new solution. Here we only reproduce a schematic 
plot of a one-dimensional slice of this scenario since the free energy depends on N local magnetizations. 




FIG. 3. Plot of the correlations q 9S (0,T) defined in ( |ll| ) (see text). The details of the simulations are displayed in Tab. Q. 
Note the finite-size scaling in the zoom in which we show a temperature window < T < 0.2: the bigger the volume, the higher 
the correlations; the same results hold for the whole displayed temperature range. 
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FIG. 5. Weighted overlap Q 9S (T) (|l|) of the equilibrium states at a given temperature with the ground states (see text). 
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FIG. 6. Scatter plot (upper panel) of the free energy density fj — fj 11 " of each equilibrium state at temperature T = 1.2 
overlap with the sample ground state <ff a (0, T). Here N = 150 and the results of 1000 different samples are superimposed, 
the lower panel we display the averaged probability distribution function defined in ( |l3| ) (see text). 
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FIG. 7. Average ground state energy for sizes ranging from N = 19 to N = 199. We label with Cooling the output of 
our algorithm and with True the exact ground state. We have averaged each point over 1000 samples. In inset we show the 
difference of the two results. 
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FIG. 8. In the main body of this figure we display the averaged overlap g 9S (0, T) vs. T. The upper curve is the same in Fig. 



for N = 150 (here we have reduced the number of considered temperatures), while the lower curve is obtained considering only 
the lowest free energy states. In inset we display the free energy difference f m in — f heated as a function of T. 



N Aq 33 #jumps ^samples 

"50 0.149(4) 0.78(1) 10000 

75 0.154(4) 0.82(1) 10000 

100 0.150(4) 0.86(1) 10000 

125 0.149(4) 0.90(1) 10000 

150 0.147(4) 0.95(1) 10000 

175 0.144(8) 0.97(1) 20000 

200 0.14(1) 1.00(2) 17186 



TABLE I. In this table we display the results for the average size Aq gs of the jumps (second column), and the average 
number of jumps per sample (third column). The number of samples considered is in the fourth column. 
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